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ABSTRACT 



A method and apparatus for automatic alignment of manipu- 
lated objects in two-dimensional and three-dimensional 
graphic space. The present invention provides an alignment 
field gradient which emanates from objects surrounding the 
manipulated object(s). As a user manipulates an object, the 
present invention attracts the manipulated object into an 
aligned position and orientation with another object(s) in the 
displayed three-dimensional display space. The present 
invention provides alignment of all combinations of verti- 
ces, edges and planar faces for three-dimensional polyhedral 
objects and for all combinations of vertices and edges for 
two-dimensional polygonal objects. 

34 Claims, 7 Drawing Sheets 
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Figure 2 
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Figure 3 




Figure 4 



05/02/2004, EAST Version: 1.4.1 




Figure 6 



0) 

£ 

(0 
Ql 



cd 
c 
o 

o 
.c 
■c 

O 



Edge-Edge (1) Vertex-Edge Vertex-Face 

C 

O 

i 

c 
o 

CO 

o 

Q_ 




Vertex-Vertex Edge-Vertex Face-Vertex 




Face-Face Edge-Edjge (2) 




7 




Edge-Face Face-Edge 



05/02/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 31, 1995 



Sheet 5 of 7 



5,463,722 




05/02/2004, EAST version: 1.4.1 



U.S. Patent Oct 31, 1995 sheet 6 of 7 5,463,722 




215 

Figure 8 




Figure 9 



05/02/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 31, 1995 



Sheet 7 of 7 



5,463,722 




Figure 10 
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AUTOMATIC ALIGNMENT OF OBJECTS IN 
TWO-DIMENSIONAL AND 
THREE-DIMENSIONAL DISPLAY SPACE 
USING AN ALIGNMENT FIELD GRADIENT 

5 

FIELD OF THE INVENTION 

The present invention relates generally to computer 
graphics and in particular to an alignment field gradient 
exerted by objects surrounding an object displayed in a 10 
two-dimensional (2D) or three-dimensional (3D) graphical 
display space appearing on a computer screen. 

SUMMARY OF THE RELATED TECHNOLOGY 

2D and 3D computer graphics have provided a new 15 
paradigm which is the foundational aspect of many modem 
design methodologies. Computer graphics have enabled the 
development of new design methodologies such as computer 
aided design (CAD). CAD is particularly useful, for 
example, to architects in creating an architectural plan for a 20 
building and to design engineers in drawing engineering 
prototypes such as new automobiles. 

CAD provides for the creation of digital representations 
of figures which previously had to be drawn by hand. 
Moreover, computer-aided designs created on a computer 25 
can. be stored in a library existing in computer memory. A 
user can recall entire designs from the computer library to 
utilize as a starting point for creating new designs. A design 
engineer can create a design for a new prototype more 
rapidly by utilizing building blocks from the CAD computer 30 
library, without having to recreate them. Thus, CAD enables 
a user to rapidly create graphical representations of a design. 

CAD, and computer graphics in general, enable a user to 
rapidly draw and manipulate figures rendered in two and 35 
three dimensions on a computer display. Typical computer 
graphics applications provide a graphical user interface to 
enable the user to manipulate displayed graphical design 
objects. The typical graphical user interface comprises a 
keyboard from which a user initiates positioning commands 4Q 
to control location of design objects in display space. 
Keyboard commands, however, are cumbersome to utilize. 
Thus, a need developed for a more direct method of manipu- 
lation of graphical objects via the graphical user interface. 
Direct manipulation may be achieved, for example, by a 45 
graphical object controller or pointing device, such as a 
mouse-driven or trackball controlled cursor, to select and 
manipulate an object to a desired location in the display 
space. 

Thus, utilizing direct manipulation, a design engineer can 5 q 
rapidly create a design for a new automobile by manipulat- 
ing the fundamental pieces of the design by initiating 
commands through the graphical user interface. For 
example, a design engineer can lay the foundation for a new 
car design by recalling a chassis and a set of wheels from a 55 
computer library. The engineer can then manipulate these 
design objects into place via a pointing device so that the 
wheels are properly positioned on the chassis. An architect 
can recall windows and doors from the computer library and 
place them into an architectural plan for a building by go 
manipulating the design objects via the graphical user inter- 
face. 

In manipulating graphical design objects, it is important 
that they be properly positioned in relation to one another. 
For example, the bottom of a window should generally be 65 
parallel with the floor in an architectural plan. Thus, some 
form of alignment operation or command is typically pro- 



vided in a computer graphical application. Moreover, typical 
direct manipulation methods, particularly when aligning one 
object to another, are cumbersome and difficult to utilize. 
Typical user interface methodologies require a user to ini- 
tiate a complex set of alignment commands in order to 
manipulate design objects into alignment in display space. 
Moreover, the typical alignment methodology utilizes a 
ruled reference grid superimposed over the computer display 
of the design. The ruled grid presents a set of vertical and 
horizontal intersecting lines which aid the user in aligning 
graphical design objects. 

There are some fundamental problems presented by the 
ruled grid. The grid restricts the designer's expressiveness. 
The designer may become preoccupied with the alignment 
grid, and thus unable to divorce himself from the grid in 
order to fully concentrate on the design process. In that 
event, he would be unable to freely manipulate the design 
objects. Moreover, the alignment commands utilized with 
the alignment grid unnecessarily complicate the interface. 

Another typical alignment methodology is to introduce 
additional alignment objects, such as those provided by the 
"guides" paradigm, and popularized by graphical applica- 
tions such as PageMaker, by Aldus Corporation of Seattle, 
Wash., and Eric Bier's "jacks". These alignment objects 
introduce a third object between two objects, wherein the 
third object is an intermediate alignment object between the 
manipulated object and the object to which it is being 
aligned, thus introducing an intermediate level of control 
between the user and the design objects in the design display 
space. Thus, the user is again encumbered by an alignment 
paradigm which introduces an unnecessary level of indirect 
control into the graphical user interface. An alignment object 
is presented which is not part of the desired result. The 
alignment object must be introduced to mediate alignment. 
The guides methodology complicates the graphic user inter- 
face, thus reducing the user's ability to freely express his 
design via the interface. 

Another typical graphical alignment technique utilizes 
what is commonly referred to as "gravity fields" or "snap- 
dragging" The gravity fields and snap-dragging paradigms 
utilize objects that appear in a scene as the alignment points 
themselves. For example, commercial applications such as 
Ashlar Vellum, by Ashlar, Inc. of Sunnyvale, Calif., and 
Claris CAD, by Claris Corporation of Santa Clara, Calif., 
utilize existing objects in the scene as alignment points. 

The gravity fields or snap-dragging technique suffers from 
drawbacks as well. When a manipulated display object 
approaches an alignment position (an object being aligned 
to), instead of smoothly and continuously approaching the 
desired position, the manipulated object jumps to the align- 
ment point. These abrupt movements are caused by the hard, 
fixed alignment threshold boundaries surrounding an align- 
ment object. When a manipulated object moves within the 
hard boundary of an alignment object's boundary line or 
alignment threshold, the manipulated object abruptly jumps 
to the alignment point associated with the alignment bound- 
ary. 

These abrupt movements introduce visual discontinuity 
into the manipulated object's motion. These abrupt move- 
ments also make it difficult for a designer to move the 
manipulated object close to, but not touching, an alignment 
point. The manipulated object jumps to the alignment point 
once it comes within a set boundary of the alignment point's 
region of influence. Moreover, if several alignment points 
are clustered close together, a small movement of the user's 
cursor, which controls movement of the manipulated object, 
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may result in the manipulated object unpredictably or errati- 
cally jumping between alignment points. 

Finally, all of the known typical graphical alignment 
techniques suffer from a common malady; they are inappro- 
priate when utilized in three-dimensional displays. A 3D 5 
alignment grid overlaid in 3D display is unwieldy. Addi- 
tional alignment objects displayed in 3D are cumbersome to 
utilize. The abrupt movements caused by hard alignment 
boundaries are particularly cumbersome in 3D. Moreover, 
these techniques are most appropriate when utilized to align 10 
points, rather than whole objects as is necessary in 3D space. 

SUMMARY OF THE PRESENT INVENTION 

The present invention provides an automatic alignment 15 
field gradient which overcomes many of the difficulties 
manifest in typical graphic alignment methodologies. The 
method and apparatus of the present invention does not 
complicate the user interface with extraneous modes, com- 
mands, or dialogs as used in the typical systems of the past 20 
The present invention provides enhanced expressiveness to 
the user by providing objects which can be freely manipu- 
lated by the user without the undesirable encumbrance of 
grids and hard alignment thresholds. Moreover, the method 
and apparatus of the present invention are transparent to the 25 
user. In the present invention, no extraneous objects appear 
in the scene. The only visual evidence of the method and 
apparatus of the present invention's operation are intermit- 
tent markers which enhance the user's ability to correctly 
manipulate objects into their desired alignment position. 30 

The influence of the method and apparatus of the present 
invention is gradual, provided as a gradient, so that the 
motion of the manipulated object is visually continuous, 
rather that jumping into alignment as do typical systems as 
discussed above. Moreover, the method and apparatus of the 35 
present invention enables the user to align any of a multitude 
of an object's displayed surface features comprising verti- 
ces, edges, and faces with any other object's displayed 
surface features. In the present invention, the burden of 
alignment is removed from the user and placed on the 40 
computer. 

The present invention provides a method for automati- 
cally aligning a first object to a second object in a computer 
system comprising a processor, memory, display and 45 
graphic object controller, the method comprising displaying 
the first object and the second object on the computer 
display, displaying a cursor coupled to the graphic object 
controller on the computer display, selecting with the cursor 
coupled to the graphic object controller the first object 5Q 
displayed on the computer display, manipulating with the 
graphic object controller the first object displayed on the 
computer display towards the second object displayed on the 
computer display, providing an alignment field gradient 
emanating from the second object and aligning the first 
object to the second object in accordance with the alignment 
field gradient 

The present invention also provides a method for auto- 
matically aligning a first object to a second object wherein 
the step of aligning starts when the first object is manipu- $o 
lated with the graphic object controller to within a first 
predetermined distance from the second object and finishes 
when the first object is manipulated with the graphic object 
controller to within a second predetermined distance from 
the second object wherein the second predetermined dis- & 
tance is smaller than the first predetermined distance. 

The present invention also provides a method for auto- 



matically aligning a first object to a second object wherein 
the step of aligning further comprises displacing the position 
of the first object from the position of the cursor coupled to 
the graphic object controller according to a strength of the 
alignment field gradient 

The present invention also provides a method for auto- 
matically aligning a first object to a second object wherein 
the step of aligning the first object to the second object 
comprises aligning one feature of the first object to one 
feature of the second object wherein a feature can be any 
element of the set comprised of an object's vertices and 
edges in the case of a two-dimensional object and vertices, 
edges and faces in the case of a three-dimensional object 

The present invention also provides a method for auto- 
matically aligning a first object to a second object wherein 
vertex features are aligned before edge features and edge 
features are aligned before face features. 

The present invention provides an apparatus for automati- 
cally aligning a first object to a second object in a computer 
system comprising a processor, memory, display and 
graphic object controller, the apparatus comprising means 
for displaying the first object and the second object on the 
computer display, means for displaying a cursor coupled to 
the graphic object controller on the computer display, means 
for selecting with the cursor coupled to the graphic object 
controller the first object displayed on the computer display, 
means for manipulating with the graphic object controller 
the first object displayed on the computer display towards 
the second object displayed on the computer display, means 
for providing an alignment field gradient emanating from the 
second object, and means for aligning the first object to the 
second object in accordance with the alignment field gradi- 
ent. 

The present invention also provides an apparatus for 
automatically aligning a first object to a second object 
wherein the means for aligning starts aligning the first object 
to the second object when the first object is manipulated with 
the graphic object controller to within a first predeterrnined 
distance from the second object and finishes aligning the 
first object to the second object when the first object is 
manipulated with the graphic object controller to within a 
second predetermined distance from the second object 
wherein the second predetermined distance is smaller than 
the first predetermined distance. 

The present invention also provides an apparatus for 
automatically aligning a first object to a second object 
wherein the means for aligning further comprises means for 
displacing the position of the first object from the position of 
the cursor coupled to the graphic object controller according 
to a strength of the alignment field gradient 

The present invention also provides an apparatus for 
automatically aligning a first object to a second object 
wherein the means for aligning the first object to the second 
object comprises means for aligning one feature of the first 
object to one feature of the second object wherein a feature 
can be any element of the set comprised of an object's 
vertices and edges in the case of a two-dimensional object 
and vertices, edges and faces in the case of a three-dimen- 
sional object 

The present invention also provides an apparatus for 
automatically aligning a first object to a second object 
wherein the means for aligning one feature of the first object 
to one feature of the second object aligns vertex features 
before edge features and aligns edge features before face 
features. 

The present invention provides a method for aligning a 
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displayed representation of an object comprising the steps 
of, displaying a- representation of a first object in an initial 
position on a display screen under the control of a processor, 
displaying a representation of a second object on a display 
screen under the control of a processor, moving the repre- 5 
sentation of the first object toward the second object in a 
visually continuous manner using a cursor whose position is 
controlled by a cursor movement mechanism, calculating a 
current position for the first object which is displaced from 
a cursor dictated position by an amount which is determined 
as if the first object was under the gradual influence of an 
alignment field emanating from the second object, and 
displaying a representation of the first object on the display 
screen in the current position. 

The present invention provides an apparatus for aligning 
a displayed representation of an object comprising means for 
displaying a representation of a first object in an initial 
position on a display screen under the control of a processor, 
means for displaying a representation of a second object on 
a display screen under the control of a processor, means for M 
moving the representation of the first object toward the 
second object in a visually continuous manner using a cursor 
whose position is controlled by a cursor movement mecha- 
nism, means for calculating a current position for the first 
object which is displaced form a cursor dictated position by ^ 
an amount which is determined as if the first object was 
under the gradual influence of an alignment field emanating 
from the second object, and means for displaying a repre- 
sentation of the first object on the display screen in the 
current position. 

The present invention also provides a method for auto- 
matically aligning a first object to a second object in a 
computer system comprising a processor, memory, display 
and graphic object controller, the method comprising dis- 
playing the first object and the second object on the display 35 
of the computer system, displaying a cursor coupled to the 
graphic object controller on the display of the computer 
system wherein the cursor defines a cursor position on the 
display of the computer system, selecting with the cursor 
coupled to the graphic object controller the first object 40 
displayed on the display of the computer system, manipu- 
lating with the graphic object controller the selected first 
object displayed on the display of the computer system, 
providing an alignment field gradient emanating from the 
second object displayed on the display of the computer 45 
system, and aligning the manipulated first object displayed 
on the display of the computer system with the second object 
displayed on the display of the computer system wherein 
when the manipulated first object is manipulated with the 
graphic object controller to within a first predetermined 50 
distance from the second object the displayed location of the 
manipulated first object on the display of the computer 
system is gradually shifted away from the cursor position 
and towards the displayed location of the second object on 
the display of the computer system and when the manipu- 55 
lated first object is manipulated with the graphic object 
controller to within a second predetermined distance from 
the second object the displayed location of the manipulated 
first object on the display of the computer system is gradu- 
ally shifted away from the cursor position and into align- 50 
ment with the displayed location of the second object on the 
display of the computer system 

The present invention also provides an apparatus for 
automatically aligning a first object to a second object in a 
computer system comprising a processor, memory, display 65 
and graphic object controller, the apparatus comprising 
means for displaying the first object and the second object on 



the display of the computer system, means for displaying a 
cursor coupled to the graphic object controller on the display 
of the computer system wherein the cursor defines a cursor 
position on the display of the computer system, means for 
selecting with the cursor coupled to the graphic object 
controller the first object displayed on the display of the 
computer system, means for manipulating with the graphic 
object controller the selected first object displayed on the 
display of the computer system, means for providing an 
alignment field gradient emanating from the second object 
displayed on the display of the computer system, and means 
for aligning the manipulated first object displayed on the 
display of the computer system with the second object 
displayed on the display of the computer system wherein 
when the manipulated first object is manipulated with the 
graphic object controller to within a first predetermined 
distance from the second object the displayed location of the 
manipulated first object on the display of die computer 
system is gradually shifted away from the cursor position 
and towards the displayed location of the second object on 
the display of the computer system and when the manipu- 
lated first object is manipulated with the graphic object 
controller to within a second predetennined distance from 
the second object the displayed location of the manipulated 
first object on the display of the computer system is gradu- 
ally shifted away from the cursor position and into align- 
ment with the displayed location of the second object on the 
display of the computer system 

BRIEF DESCRIPTION OF THE DRAWINGS 

. The present invention is illustrated by way of example 
and not limitation in the figures of the accompanying 
drawings, in which like references indicate similar elements, 
and in which: 

FIG. 1 illustrates a preferred hardware embodiment of the 
present invention; 

FIG. 2 is an illustration showing how, in a preferred 
embodiment, as the user drags one object toward another 
object the first object is drawn into alignment with the 
second object; 

FIG. 3 is a graph illustrating a preferred embodiment in 
which, as a point of one object is moved within the influence 
of an alignment gradient field, the point smoothly pulls away 
from the cursor and into alignment with another object; 

FIG. 4 is a graph illustrating how in a preferred embodi- 
ment the behavior of FIG. 3 is implemented by a weighted 
average of a function that depends on the distance between 
a manipulated object P and an alignment object Q; 

FIG. 5 is an illustration of a preferred embodiment in 
which, as an edge of a polygon of a manipulated object is 
dragged toward another object, die edge of the polygon of 
the manipulated object is pulled away from the cursor and 
into alignment with the other object in both position and 
orientation; 

FIG. 6 is an illustration of the preferred embodiment 
showing how the ten possible alignments for 3D objects fall 
into three groups; 

FIGS. 7A, 7B, and 7C are illustrations of a preferred 
embodiment showing how rotational alignment for 3D 
objects falls into three categories: Position-only alignment 
leaves the orientation of the manipulated object P 
unchanged. Paralleled alignment rotates the manipulated 
object P so that its defining vector is parallel to the alignment 
object Q. Orthogonal alignment rotates the manipulated 
object P so that its defining vector is perpendicular to the 
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alignment object Q; 

FIG. 8 is an illustration showing how in a preferred 
embodiment, when two objects are aligned, the pair of 
features that are already in the best or closest alignment 
determine how the two objects will be placed into precise 5 
alignment; 

FIG. 9 is an illustration of how in a preferred embodiment, 
in order to determine how two objects should align, the 
closest point between the two objects is determined, then the 
features incident to the closest points are compared; and, 10 

FIG. 10 is an illustration showing how in a preferred 
embodiment, automatic alignment of an object is imple- 
mented for (a) alignment to multiple features; (b) special 
points; (c) curves and geometric objects; and (d) persistent 
alignment 3 

DETAILED DESCRIPTION OF THE PRESENT 
INVENTION 

Referring now to the drawings, a representative hardware 20 
environment for the present invention is depicted in FIG. 1, 
which illustrates a suitable hardware configuration of a 
computer system 1640 in accordance with the present inven- 
tion. The computer system 1640 comprises a central pro- 
cessing unit 1610, such as a conventional microprocessor, 25 
and a number of other devices interconnected via a computer 
system bus 1612. The computer system 1640 further com- 
prises a random access memory (RAM) 1614, a read only 
memory (ROM) 1616, an input/output (I/O) adapter 1618 
for connecting peripheral devices such as nonvolatile 30 
memory devices such as disk units 1620 to bus 1612, a user 
interface adapter 1622 for connecting a keyboard 1624, a 
graphic object controller 1626 such as a mouse, a speaker 
1628, a microphone 1632, and/or other user interface 
devices (not illustrated) to the bus 1612. The computer 35 
system 1640 may also comprise a communications adapter 
1634 for connecting the bus 1612 to a data processing 
network 1630 (not illustrated) and a display adapter 1636 for 
converting the display information from the bus 1612 to 
video information to drive a display device 1638. 40 

In a preferred embodiment, a Macintosh Quadra 950 
computer manufactured by Apple Computer, Inc. of Cuper- 
tino, Calif., may be utilized. In a preferred embodiment, the 
present invention provides a three-axis mouse as the graphi- 
cal object controller for use with the graphical user interface. 
The present invention utilizes the Macintosh computer sys- 
tem and the mouse to enable a user to manipulate and 
automatically align objects appearing on the computer dis- 
play screen. The manipulated objects appear as objects in 2D 5Q 
and 3D display space which may be compiled into an 
aggregation of objects viewed together as a display scene. 

Users can utilize the 3D mouse to move objects to their 
approximate desired positions after which the present inven- 
tion provides assistance in order to attain more exact object 55 
positioning (orientation and alignment). Additional means 
are thus provided by the present invention to precisely and 
automatically align a manipulated object with other objects 
which are displayed adjacent the manipulated object in a 
two-dimensional or three-dimensional display space. go 

The alignment method and apparatus of the present inven- 
tion enables the designer to freely manipulate objects in 
display space without reducing the available expressiveness. 
The alignment method and apparatus of the present inven- 
tion does not clutter the interface with unnecessary align- 65 
ment commands and objects which typically increase the 
complexity of the graphic user interface. The present inven- 



tion also enables a user to align an object under the influence 
of an alignment field gradient. This is accomplished by 
manipulating an object close to a second object so that as the 
manipulated object comes within a region occupied by an 
alignment influence field gradient of the second object, the 
gradient gradually affects the alignment of the manipulated 
object The effect of the alignment field on the manipulated 
object is gradual in that the effect becomes stronger as the 
manipulated object gets closer to the stationary object. 

MAGNETIC ATTRACTION BETWEEN 
DISPLAY OBJECTS 

In a preferred embodiment, the automatic alignment 
method and apparatus of the present invention is based on a 
model of magnetic attraction between two objects. Objects 
in the present invention are attracted to each other, just as a 
magnet is attracted to the metal door of a refrigerator. For 
example, a magnet can be moved freely around the kitchen, 
but, when the magnet moves close to a metal object, such as 
a refrigerator door, the natural magnetic influence of the 
magnet attracts the magnet to the door. 

In a preferred embodiment, the magnetic attraction align- 
ment field is implemented as a gradient. The magnetic 
attraction and associated alignment influence of the field 
emanating from an alignment object becomes stronger as a 
manipulated object approaches tie alignment object, simi- 
larly to the magnetic attraction of a magnet becoming 
stronger as it moves closer to the metal refrigerator door. 

In a preferred embodiment, alignment may be made with 
respect to any feature (face, edge or vertex) of an object. Just 
as with a magnet having a thin rectangular shape, all features 
of the magnet, the planar faces, the edges, and the corners 
are attracted to the refrigerator door. 

Moreover, just as any one of the magnetic surfaces may 
contact the door, any surface on a manipulated object may 
contact another object The rectangular magnet or an object 
in the alignment field gradient will be positioned so that its 
corner (vertex), its edge, or the front and back planar faces 
of the magnet or object may contact the door or another 
object when desired. The alignment field gradient of the 
present invention emulates the magnet's surface contacting 
the door,, which can also slide around on the door's surface, 
within the two-dimensional plane of the door's face, without 
losing contact The present invention also emulates rotation 
on the two-dimensional plane of the door without losing 
contact with it Further, the present invention emulates the 
behavior of the magnet which can be gradually removed 
from contact with the door to terminate contact between the 
magnet and the door. 

In a preferred embodiment, objects appearing in a display 
scene exert a gradual alignment influence on a manipulated 
object. The alignment influence exerted on manipulated 
objects by other objects appearing in the display scene is in 
effect by default unless it is disabled by the user. Thus, the 
method and apparatus of the present invention emulates the 
ever-present natural attraction between magnets and metal 
objects. 

The alignment field gradient of the present invention aids 
a user in aligning objects. Thus, just as a person holding a 
refrigerator magnet does not have to issue alignment com- 
mands to ensure that the magnet is touching the door, or that 
the planar faces of the magnet and the door are parallel when 
in contact, a user does not have to initiate alignment com- 
mands to align objects in display space or to insure that the 
objects are parallel when in contact 
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The method and apparatus of the present invention emu- 
lates the magnetic attraction between objects so that an 
object may be automatically aligned without extraneous user 
intervention. The operation of the present invention is highly 
intuitive thus m a k i n g it easy to comprehend with little or no 5 
explanation required Intuitive comprehension is aided by 
the visual and aural feedback provided by the preferred 
embodiment of the present invention. This feedback enables 
a user to intuitively and spontaneously comprehend and 
utilize the alignment field gradient paradigm. 10 

In a preferred embodiment, the alignment influence is 
gradual and continuous within a region of influence sur- 
rounding an alignment object The user interface is unclut- 
tered and unfettered by additional alignment objects and 
cumbersome alignment commands. Just as a magnet can be is 
placed anywhere in a kitchen, including arbitrarily close to 
a refrigerator door, a manipulated object in a display scene 
can be placed arbitrarily close to another object. The present 
invention does not restrict the user with alignment grids or 
by hard alignment thresholds. The user's expressiveness is 20 
enhanced. The user may freely manipulate objects using the 
transparent interface provided by the present invention. 

The characteristics of the alignment field gradient are 
incorporated into the behavior of the objects displayed and 
manipulated utilizing the method and apparatus of the 25 
present invention in a preferred embodiment Moreover, the 
present invention is appropriate for use in a 2D or a 3D direct 
manipulation graphical editor. 

In the preferred embodiment method and apparatus of the 
present invention, a manipulated object, chosen by pressing 
and holding down a mouse button, becomes "metallic" and 
all the other objects in a scene become "magnetic." Thus, a 
manipulated object is attracted to nearby objects in the 
display scene by the alignment field gradient The manipu- 
lated object may be automatically aligned with a nearby 
object under the influence of the alignment field gradient 

MANIPULATION OF OBJECTS 

A preferred embodiment enables a user to translate and 40 
rotate objects in three dimensions by direct manipulation. 
FIG. 2 illustrates a portion of a display screen in a preferred 
embodiment of the method and apparatus of the present 
invention. A cone-shaped cursor 20, an object 22 (cone- 
shaped in this example), and another object 24 (in this 4 * 
example, a plane) are shown in FIG. 2. An intermittent 
marker or alignment icon 28 appears as a spiral between 
object 22 and plane 24 to indicate an alignment field 
between object 22 and plane 24. Further, in the preferred 
embodiment of the present invention, the object 22 casts a 50 
shadow 26 which in this example falls onto plane 24. 

THE OBJECT MANIPULATION CURSOR 

In the preferred embodiment of the present invention, the 55 
object manipulation cursor 20, controlled by a three-dimen- 
sional graphical object controller input device (1626 in FIG. 
1) such as a 3D mouse or trackball, comprises a small cone 
that can be moved in three dimensions. In addition to 
moving the cursor latitudinally and longitudinally within the 50 
plane of the display screen, the 3D mouse 1626 also enables 
a user to move the cursor 20 into and out of the screen 
perpendicular to the plane of the display screen, toward and 
away from the user viewing the display screen. 

In a preferred embodiment, moving the cursor 20 inside 65 
of a displayed object 22 causes the displayed object to 
become translucent, so that the cursor remains visible while 



10 



it is inside of the translucent object The translucent object 
22 thus remains visible as the visible cursor 20 moves 
around inside of it. In a preferred embodiment, when a 
manipulated translucent object 22 is moved inside of another 
object, the manipulated translucent object 22 becomes 
opaque and the other object becomes translucent so that the 
manipulated object 22 remains visible inside of the other, 
now translucent, object 

The cursor 20 enables the operator to manipulate the 
position and orientation of a selected object In the preferred 
embodiment of the present invention, pressing the mouse 
button and keeping it depressed when the cursor 20 is near 
the center of the displayed object 22 enables the user to 
positionally translate the object in accordance with the 
cursor 20. That is, the object 22 does not rotate as it is moved 
across the display screen. Furthermore, in the preferred 
embodiment, the cursor 20 changes shape when in the center 
of the object 22 to indicate that the cursor 20 has entered the 
center region of the object 22 where the object 22 can be 
translated without being rotated. 

In the preferred embodiment of the present invention, 
selecting the object 22 by depressing the mouse button and 
holding it down while the cursor 20 is near the edge of the 
displayed object 22 and then manipulating the displayed 
object 22 causes the displayed object 22 to trail along behind 
the cursor 20, a technique referred to as "tail dragging." 

Tail-dragging, as is known in the art and as described in 
U.S. Pat No. 5,146,212 entitled t< Manipulatable Orientation 
For A Translatable Graphic Object," takes a stream of 3D 
positions as input and produces a stream of yaw and pitch 
orientations as output When combined with the original 3D 
stream, this gives control of five different (though not 
independent) degrees of freedom. Tail-dragging is loosely 
based on a physical model. Consider dragging a rock behind 
oneself by a rope. Hie rock stays a constant distance behind 
one, at an angle that changes depending on one's path. 
Tail-dragging calls the free end of the rope the "head" and 
the rock the "tail." For each new head position, a new tail 
position is computed by stretching the rope from the old tail, 
then restoring the rope to its original length. More precisely, 
to find the tail position at time step t, 



tail/ = head, + 



taiVi - head< 
tailM -headj 



tailo-heado- 



The new tail,head, vector can be compared to the original 
tail^ead^ vector to find the yaw and pitch angles to rotate 
between the two states. The remaining degree of freedom 
(rotation about the new vector, or roll) can be constrained by 
computing an angle to minimize its change between steps. A 
user can translate and rotate an object simultaneously, using 
tail-dragging, by clicking the mouse button while touching 
the object with the cone cursor. The point selected on the 
object is considered the initial head position, and the initial 
tail position is computed as the point opposite the object 
center from the initial head position. As the user drags the 
object by the head position, the trailing tail position thus 
causes the object's orientation to change. 

The tail dragging mode of manipulation thus allows an 
object 22 to rotate freely about the location point of the 
cursor as the cursor is moved about Thus, the tail dragging 
manipulation mode alters both the position and orientation 
of the displayed object 22. 

In the preferred embodiment of the present invention, 
dragging a manipulated object close to another object within 
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a display scene, so that the manipulated object is within the 
influence of the other object's magnetic alignment field 
gradient, causes the manipulated object to become automati- 
cally attracted to and drawn into alignment with the other 
object under the influence of the alignment field gradient 5 
exerted by the other object 

As shown in FIG. 2, when a user moves the cursor 20 
inside of an object 22, axes or cross hairs 27 appear that 
extend from the tip of the cursor 20 out in six directions to 
the boundaries of the object 22. Thus, a 3D set of axes or 10 
cross hairs 27 are provided which intersects the cone-shaped 
tip position or location point of the cursor 20 within an 
object 22. The axes 27 provide visual feedback to the user 
to further facilitate location of the cursor 20 inside of an 
object 22. Further, in the preferred embodiment of the J5 
present invention, when the user selects an object 22 for 
manipulation, the up of the cursor 20 and the axes 27 
become positionally fixed within the object 22 as long as the 
object 22 stays outside of another object's alignment field 
gradient. 20 

The object 22 follows the tip of the cursor 20 during 
manipulation until the manipulated object 22 comes within 
an alignment field gradient designated by a distance h, as 
shown in FIG. 3, of another object thus bringing the manipu- 
lated object 22 within the influence of the alignment field 25 
gradient of the other object Still further, in the preferred 
embodiment of the present invention and referring again to 
FIG. 2, when a manipulated object . 22 comes under the 
influence of an alignment field of another object, the object 
22 starts to pull away from the cursor dictated position. An 30 
indicator 38 is displayed between the tip of the cursor 20 and 
the cross hairs 27 displayed within the object 22 to provide 
visual feedback to the user of the effect of the alignment field 
gradient. 

35 

FEEDBACK TO THE USER 

In a preferred embodiment, the method and apparatus of 
the present invention conveys an alignment field gradient 40 
influence to the user in three ways. First, the manipulated 
object 22 and axes cross hairs 27 visually pull away from the 
displayed cursor 20, as indicated by visual marker 38, and 
into alignment with the other object 24. Second, a small 
spring-like marker or alignment icon 28 appears between the 45 
manipulated object 22 and the alignment object 24 thus 
indicating where the alignment field gradient influence is 
occurring. Third, the present invention generates sound 
effects that correspond to the gradual alignment and contact 
between the two objects. The sound effects are generated 50 
when the manipulated object 22 is dragged within the 
magnetic region of influence of the alignment object 24. As 
the objects come closer together, the sound effect becomes 
louder as the alignment influence becomes stronger. These 
three feedback mechanisms work in conjunction to provide 55 
an intuitive feel to the automatic alignment gradient field 
method and apparatus of the present invention. The intuitive 
feel is experienced by the user, which makes use of the 
alignment field gradient of the present invention easy to 
comprehend and utilize. 60 

Informal user testing indicates that users take advantage 
of the automatic alignment field gradient of the present 
invention with ease. By exploration alone, users typically 
discovered the existence of the alignment influence and 
utilized the capability without the benefit of previous 65 
instruction. Users often spontaneously described the para- 
digm as "magnetic attraction." Further, users were easily 



taught the potentialities for alignment between the various 
features or combinations of the faces, edges, and vertices of 
the display objects. 

ALIGNING TWO VERTICES 

In a preferred embodiment, when the user drags a vertex 
of a displayed object towards the vertex of another object 
displayed in a scene, based on the model of magnetic 
attraction, the attraction between the two objects becomes 
stronger as the objects move closer together. FIG. 3 illus- 
trates the effect in a preferred embodiment The vertex that 
is being dragged is designated P, and the attractive vertex 
that is attracting P in the scene is designated as Q. The cursor 
specifies a position, A, for the dragged vertex. If P were 
pulled into complete alignment with Q, its position would be 
B. The vertex P is displayed at C, a position that is influenced 
by both the cursor position and P's attraction to Q. 

Normally, when a manipulated object is outside of the 
influence of another object, point C is then co-located with 
point A, and the vertex follows the cursor exactly. As the 
user drags the manipulated object's vertex within a certain 
distance, h, from the other object's vertex, point C begins to 
pull away from point A and toward point B. As the user 
continues to move the manipulated object toward the other 
object (thus moving point A toward point B), point C pulls 
further away from point A and moves closer to point B. 
When point A moves within a certain distance, I, of point B, 
point C is automatically drawn by the present invention into 
alignment with point B. 

It is important to note that with the apparatus and method 
of the present invention, the path of point C is smooth and 
continuous. In the present invention, point C does not 
"jump" into alignment with point B. Thus, the manipulated 
vertex can be placed arbitrarily close (as long as point A is 
not within distance I of point B, as was explained above) to 
the stationary vertex in the scene thus providing the user 
with enhanced expressiveness. 

Position C lies somewhere between position A and posi- 
tion B. In a preferred embodiment, position C can be 
detenrrined by a weighted average, based on a weighting 
function, as described in equation 1, 



(1) 



where w represents the strength of the alignment field 
gradient at a distance, d, from the object from which the 
alignment field emanates. 

The curve illustrated in FIG. 3 can be translated to the 
weighting function shown in FIG. 4. In a preferred embodi- 
ment this function is modeled by equation 2, 



(2) 



l«t<h 



( h ~ d 



d*h 0 

where d represents the distance between points A and B. In 
a preferred embodiment, the cubic exponent is chosen to 
emulate the natural field strength of magnetic attraction. 
Preferably, the distance h is chosen so that the attraction is 
easy to invoke yet small enough to eliminate spurious 
attractions. In a preferred embodiment, h is approximately 
one fifteenth of the width of the field of view in the plane of 
interest The value of I is preferably chosen so that complete 
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alignment is easy to attain by. direct manipulation via the 
mouse, or some other manipulation device provided by the 
interface, yet is still small enough so that close placement of 
objects is possible without triggering automatic alignment. 
In a preferred embodiment, a value for 1 equal to appro xi- s 
mately one quarter of h is utilized. 



ROTATIONAL ALIGNMENT IN TWO 
DIMENSIONS 



10 



In the preferred embodiment, the alignment field gradient 
of the present invention specifies rotation as well. Just as the 
face of the magnet can easily be made coincident with the 
plane of a refrigerator door and then rotated on that plane, 
a face of a manipulated object can be easily made coincident is 
with the plane of another object and rotated on the plane of 
the other alignment object. 

An example of rotational alignment follows. FIG. 5 
illustrates how as an edge 100 of a polygon 22 is dragged 
towards an edge 110 of another polygon 24, it is pulled from 20 
the cursor 120 and toward alignment in both position and 
orientation. As shown in FIG. 5, the user drags the edge 100 
of object 22 from left to right towards object 24. As the edge 
100 moves closer to the edge 110 in the scene, the edge 100 
begins to pull away from the cursor 120 position while 25 
simultaneously rotating into alignment with the edge 110. 
Thus, in the present invention, as the two objects 22 and 24 
come close together edges 100 and 110 are automatically 
and precisely aligned in a parallel fashion. 

As illustrated in FIG. 5, the position specified for edge 30 
100 by the cursor point 120 is a point designated A^y and the 
orientation of edge 100 specified by the cursor point 120 is 
an angle, A e . The position of A^y, when object 22 is placed 
in alignment with object 24 is designated and the 
orientation of edge 100 is an angle B e . The object 23 (the 35 
manipulated object 22) under the influence of the alignment 
field gradient of object 24 is displayed somewhere between 
object 22 and object 24, at position C xr with orientation C e , 
which in a preferred embodiment is determined by interpo- 
lation utilizing equation 3, 40 

Ce=A e HBe-A#¥\ 8O+360)AfOD 360-180 

where d represents the shortest distance between the edges 
of the objects 22 and 24. 

ROTATIONAL ALIGNMENT IN THREE 

DIMENSIONS so 

Aligning polygonal objects in two dimensions is either a 
matter of position and orientation (for edge-edge feature 
alignment) or position only (for vertex-vertex, vertex-edge 
or edge-vertex feature alignment). In a preferred embodi- 
ment, any vertex, edge and/or face feature of a manipulated 
object may interact, under the influence of the alignment 
field gradient, with a vertex, edge, or face feature of another 
object in a scene from which the alignment field emanates. 

In three dimensions, the cursor specifies a position and go 
orientation for a feature P of an object. The goal is to align 
a feature P of one object with a feature Q of another object 
thus aligning the two objects. Preferably, the point, A w of 
the feature of one object that is closest to the point, & xr , of 
the feature of another object is aligned. 65 

Referring now to FIGS. 7A, 7B, and 7C, although the 
cursor specifies a full three degrees of rotational freedom for 
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an object, it is useful to refer to a "defining vector" 
designated as A^ for each feature of the object A vertex, 
however, has no defining vertex, see FIG. 7A. The defining 
vector for a face is the unit vector normal to the face, see 
FIG. 7B. The defining vector for an edge is the unit vector 
parallel to the edge, see FIG. 7C. The defining vector for the 
feature as specified by the cursor is designated A deJi The 
feature of one object that a feature of another object is being 
aligned with may also have a defining vector, O^ see FIGS. 
7B and 7C. Defining vectors are utilized in the preferred 
embodiment, instead of a more complete representation of 
three-dimensional rotation to save processing time and 
memory utilization because defining vectors are easier to 
manipulate mathematically in determining and interpolating 
orientation. 

Referring now to FIG. 6, the ten attractions between 
feature types for 3D polyhedral objects can be seen. Notice 
that there are two cases for the edge-edge feature alignment: 
either the edges are made to intersect at a point or they are 
made coincident These ten cases can be combined into three 
general categories, as shown in the figure and as discussed 
below. Note that each category generates rotations differ- 
ently, as was illustrated in FIGS. 7 A, 7B, and 7C and as will 
be explained below with reference to FIG. 6. 

Position-Only Alignment* position-only alignments (as 
illustrated in FIG. 6, marked "Position-Only") do not change 
the orientation of the object, and do not deal with defining 
vectors. The object is displayed at a new position interpo- 
lated between the position as defined by the cursor and the 
position as defined by the alignment field gradient In a 
preferred embodiment, the interpolation is determined 
according to equation 4: 



(4) 



where d represents the distance between points A XYZ and 
B **z« as was illustrated in FIG. 5. The manipulated object is 
translated so that A XYZ matches C XYZ . The orientation of the 
manipulated object is as specified by the direct manipulation 
cursor. 

Parallel Alignment: parallel alignments (as illustrated in 
FIG. 6, marked "ParallelD align two features in orientation 
by rotating the defining vector of the feature of the manipu- 
lated object so that it becomes parallel to the defining vector 
of a feature of an alignment object. The defining vector that 
rotates the features into alignment, B^ is one of the two 
unit vectors that are parallel to.Q^ Trie unit vector that 
rrnnimizes rotation is chosen, i.e., the one that is closer in 
direction to A^ In a preferred embodiment, this function is 
implemented as follows in equation 5, 



Bor- 



is) 

The manipulated object is rotated so that its resulting 
defining vector approaches B^ Rotation is in the plane 
spanned by A def and B^ about an axis, v, that is perpen- 
dicular to both defining vectors. In a preferred embodiment 
v is calculated utilizing equation 6. 



i=normalize (S^/cA^) 



(6) 



In a preferred embodiment the amount of rotation, 8, is 
determined by finding the angles between the defining 
vectors and then scaling by the weighting function, as shown 
in equation 7. 



a) 
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A rotation matrix, M, is derived from v and 8 as follows: preferred embodiment, an alignment field gradient influence 



(1 - cos 8) vx + cos 6 (1 -cos8) vjrvy + vzsinB (I -cos 6) vjrvz- vy sin 6 

M= (l-cose)vxvr-vzsine (1 -cos6) vy 2 + cos 9 (1 -cos6) v r vz + vy sine 

(l-cos8)Kjrvz + vysine (1 - cos 8) vyvz-vxsinQ 



The desired position, C XYZy is computed as in the Posi- 
tion-Only case as discussed above with reference to equation 
(4). The transformation for the. manipulated object is com- 
puted by composing transformations to translate to the 
origin, to rotate about v by the angle 9, and to translate the 
origin to C xyz . 

Orthogonal Alignment: orthogonal alignments (as illus- 
trated in FIG. 6, marked "Orthogonal") operate to align two 
features in orientation by making the defining vector of the 
feature of the manipulated object orthogonal to the defining 
vector of the feature of the alignment object The defining 
vector that rotates the features into alignment, is 
perpendicular to a defining vector of a feature of the align- 
ment object's defining vector, in the plane spanned by A def 
and Again, there are two solutions and the one that 
minimizes rotation is used in the preferred embodiment In 
a preferred embodiment, the minimal rotation is deterrnined 
by equation 8, by removing from A^ its orthogonal pro- 
jection onto 

fid^snormalize (A< kr {A rfe/ A <i ^Q^. (8) 

The final translation and rotation of the manipulated object 
is determined as in the Parallel case, as was discussed above. 

ALIGNING OBJECTS 

The discussion above explained alignment of one feature 
to another feature. Further, the preferred embodiment 
method and apparatus of the present invention automatically 
aligns complex objects comprised of those features. Con- 
sider the case of manipulating a square towards another 
square in two dimensions, as shown in FIG. 8. The most 
natural alignment for the two objects, P 210 and Q 200, is 
to conjoin P^ and Q^. 

Each square, P and Q, is composed of eight features 
comprising four vertices (P^, Pv2» p v3 and P V4 ) and four 
edges (P^, Pq, P^ and P^. An alignment can be pro- 
duced for every combination of the features of P with the 
features of Q. Of the 64 possible solutions in this example, 
in a preferred embodiment, a very natural heuristic is 
provided to choose the feature of P which is nearest to a 
feature of Q. Relying on the closest distance between the 
features reduces the 64 possible combinations to three: 
Pe3-Q^ Pv3-Qh2> and P EA -Q E2 . 

Another measure of distance between objects is the angu- 
lar disparity between two features of different objects. In a 
preferred embodiment, a pair of features with great angular 
disparity can be ignored. In a preferred embodiment, only 
features within 20° of alignment of each other will be 
considered. This notion of angular disparity makes P^-Q^ 
a better choice than P^-Q^, but does not indicate useful 
information, about P^-Q^ because the angular disparity 
between a vertex and an edge is undefined. 

In the preferred embodiment of the present invention, 
based on the model of magnetic attraction, faces have a 
stronger alignment field gradient attraction than edges, 
which have a stronger attraction than vertices. Thus, in a 



is provided that fulfills the intuitive expectations of the user 
in this example, as is explained more fully below. 

In a preferred embodiment, the present invention discards 
any potential alignment with an object whose distance, d, is 
greater than the limit for attraction distance, h, or whose 
angular disparity is greater than the desired limit In a 
preferred embodiment, when comparing two potential 2D 
alignment features, three general heuristics are utilized to 
select the best pair of alignment features: (1) Choose the 
feature pair with the smallest distance, d; (2) When the d's 
are equal for two candidate alignment features, choose an 
edge-edge alignment before anything else; and (3) When the 
d's are equal for two candidate alignment features and both 
alignment features are edge-edge, choose the one with the 
greater dot product lA deJ >B di ^. Referring again to FIG. 8, in 
a preferred embodiment, applying these heuristics, the 
desired alignment, P £4 -Qe2> is selected from the 64 possible 
combinations of features in FIG. 8. 

In a preferred embodiment, in three dimensions, two 
alignment feature pair candidates are compared to select the 
best pair of alignment features utilizing the following heu- 
ristics: (1) Choose the alignment feature pair with the 
smallest distance, d; (2) When the d's are equal, choose the 
feature pair with the "stronger" alignment influence: Parallel 
before Orthogonal; and Orthogonal before Position-Only; 
(3a) When d's are equal and both are Parallel, choose the 
alignment object with the greater dot product IA^B^; 
and (3b) When the d's are equal and both are Orthogonal, 
choose the alignment feature pair with the lesser dot product 

The following two sections discuss generating those com- 
binations of features and deterniining the shortest distance 
between them, in the 2D and the 3D cases. 

CLOSEST FEATURES IN TWO DIMENSIONS 

Many features may qualify as the nearest feature pair 
between two objects. In FIG. 8, there are three pairs of 
features at the same distance (because the closest points 
between P^-Q^, PV^-Q^, and P^-Q^ are all at the 
same distance, d, as indicated by the dotted line 215), 
however, only the most restrictive of these features, 
Pv3"Q£2» is chosen. The other feature pairs are then deter- 
mined by a process referred to herein as 'feature expansion," 
as discussed more fully below. 

When comparing feature pairs, a pair of features will be 
an accepted solution only if it is the most restrictive feature 
pair at that distance. To determine the closest features of a 
pair of objects, the distances between all combinations of 
features are determined. For polygonal objects in two 
dimensions, the closest features might be two vertices, a 
vertex and an edge, or two intersecting edges. Each combi- 
nation of feature types is "compared by a different method, as 
follows: 

Vertex- Vertex Feature Comparison: The distance between 
a pair of vertices is determined by Pythagorean distance, a 
method well known in the art. Vertex-Edge Feature Com- 
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parison: A vertex is compared to an edge by projecting the 
vertex onto a line through the edge. If the vertex is at p and 
the endpoints of the edge are q 0 and q„ then the projection, 
r, is determined by equation 9. 



(p-go)(gi-9o) 
~ (?i- go) (g\ -go) 

r=q 0 + Kqj- qo). 



(9) 



If the projection point lies within the edge, i.e., (kt<l, 
then the vertex projects onto the edge, and the distance 
between p and r is compared to see whether this pair of 
features is the closest Ift^O then the vertex at q 0 is the same 
distance from p, but is more restrictive; if t^ 1, then the 15 
vertex at q! is more restrictive; in either case, the pair is 
rejected. 

Edge-Edge Feature Comparison: to detect if two edges 
intersect, the point of intersection of two lines through the 
edges is determined. If the endpoints of the edges are p 0 and 20 
p lf and qo and q lt the point of intersection, r, is computed by 
equation 10. 



v ; = (p or - p jr > pax - P JX ), 
V2 = (gor-g/y»?flx-?/x). 



(10) 



Jl=- 



V2 - go + vi • po 

V2 • (pi -PO) 

vi (gi-go) 



30 



r =Po + h (Pi -Po)- 

If the intersection point lies within the two edges, i.e., 
(kt,<l and Oct^l, then the two edges intersect, with d=0. 35 

In a preferred embodiment, for two objects, P and Q, each 
combination of features is compared: P T s vertices to Q's 
vertices, P's vertices to Q's edges, Q's vertices to P's edges, 
and P's edges to Q's edges. 



40 



CLOSEST FEATURES IN THREE DIMENSIONS 

For polygonal objects in three dimensions, finding the 
closest feature pairs includes dealing with polygonal faces. 
In a preferred embodiment, to find the closest points 
between a pair of features on two objects, the feature pairs 
are iterated over, comparing the vertices, edges and faces of 
one object to the vertices, edges and faces of another object 
However, in a preferred embodiment, the closest features are 
never both faces — an edge or vertex will always be closer. 

For each pair of features, the points on the two features 
that are closest to one another are determined. To facilitate 
this determination, edges are transformed into lines and 
faces into planes. The closest points between the two trans- 
formed or generalized features is then determined. If the 
points fall outside of the restrictions on the features, for 
example the endpoints of an edge or the bounding edges of 
a polygonal face, then the pair is discarded. Otherwise, the 
distance between the points is determined. The pair of points 
with the smallest distance is remembered, along with the 
feature types (vertex, edge, face) on which the points lie. 

In a preferred embodiment, each combination of feature 
types (excluding face-face) is compared by a different 
method, as follows: 

Vertex-Vertex Feature Comparison: When a vertex is 
compared to another vertex, the closest points are the 
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vertices themselves. 

Vertex-Edge Feature Comparison: A vertex is compared 
to an edge by projecting the vertex onto a line coincident 
with and extending through the edge. In a preferred embodi- 
ment, if the vertex is at a point p, and the edge's endpoints 
are q 0 and q l5 then the projection of the vertex on the edge 
is r, as determined by equation 11. 



10 



t p-(gi-flp)-g0'(gi-ga) 

(?1-?Q)'(?1-0O) 



(II) 



If r lies strictly within the edge, 0<t<l, then the vertex 
projects onto the edge, and p and r are potentially the closest 
features, otherwise the vertex-edge pair of features is 
rejected. 

Vertex-Face Feature Comparison: A vertex is compared to 
a face by projecting the vertex onto the plane that contains 
the face's polygon. If the vertex is at p, the face passes 
through q with normal n, the point of projection is r, as 
determined by equation 12. 



25 



r=p-i(q-p>n)n 



(12) 



In a preferred embodiment, the face must contain r if the 
vertex-face pair is to be considered as the closest feature 
pair. The point of projection is compared to each edge to 
determine if it is "inside" or "outside" of the line that the 
edge determines. In a preferred embodiment, with the edge' s 
endpoints denoted e 0 and c v the point lies outside the 
polygon when the result of equation 13 is greater than zero. 



(^-*aM(ei-«o)X'0 



(13) 



Note that equation 13 works for convex polygons whose 
edges are listed in counter-clockwise order. If r is within the 
polygon then p and r are potentially the closest features. 

Edge-Face Feature Comparison: An edge is compared to 
a face in much the same way as a vertex to a face. Instead 
of working with the projected point, however, the intersec- 
tion of the edge line with the face polygon plane is used for 
alignment determination purposes. In a preferred embodi- 
ment, if the edge has endpoints denoted p 0 and p x , the face 
passes through q with normal n, the intersection is r, as 
calculated by equation 14. 



n(pn-q) 

n -(pi-po) 



(14) 



r=Po + t(Pi~Pj 

If the edge is parallel to the face then the denominator 
used to compute t is zero, and the pair is discarded. The pair 
is considered only if r is within the edge segment, Oct<l . The 
two points resulting from a successful comparison of a face 
with an edge are coincident 

Edge-Edge Comparison: The closest points between two 
edges is determined by finding the closest possible approach 
between the lines through the two edges. In a preferred 
embodiment, if the edges have endpoints p 0 and p lt and c^ 
and qj, the closest points, r, and r 2 , are determined by 
equation 15. 



v = (P/-Po)x( fli - 9o ) 



(15) 
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Iqu-poqi-qov 



'i=Po + h (P/~PoX 
*2 = q<> + ' 2 (?/ - ft) 



FEATURE EXPANSION 
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If the edges are parallel, then the denominator used to find 
tj and tj is zero, and the pair of features can be discarded. 
If the points are within the edge segments, i.e., 0<t,<l and 
0<t|<l, then the points t x and r 2 are the closest between the 
edges. 

Since only distances which arc less than a constant, h, are 
of interest, computational speed is increased by rejecting 
any pair of objects or features whose bounding boxes (the 
smallest axis-aligned box that contains all the points of all 
the features of the object, as is well known in the art) are 
greater than h apart If the objects are of great quantity or 2t> 
complexity, a spatial sorting technique could be used to 
reduce the number of comparisons. 

For each pair of features compared in this way, the 
distance between the closest points is determined. The 
comparison that results in the smallest distance between the 25 
features is selected as optimal. When the process is com- 
plete, this results in the closest points between objects P and 
Q, and the principal features that contain the points. 
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Once the closest points between the manipulated object 
and the alignment object in the scene are determined, an 
alignment between the two objects can be determined as 
follows. The closest points on each are expanded into a list 35 
of all features adjacent to the two points. Thus, two lists are 
generated: one for all features coincident with the closest 
point on the manipulated object and one for all features 
coincident with the closest point on the alignment object 

Referring again to FIG. 8, the closest point on P is P^ 
which is incident to a vertex (P^ itself) and two edges (P^ 
and P^ while the closest point, on Q is which is 
incident only to an edge (Q^ itself). Referring now to FIG. 
9, the closest point 222 on object P 220 is incident to a 
vertex, three edges and three faces while the closest point 
232 on object Q 230 is incident only to a face. The set of all 
features adjacent to (coincident- with) the closest set of 
points between the two objects is called an "expansion list" 

The expansion list for each point is determined easily 
since the features that contain the point have already been 
located and stored for this use during the near point deter- 
mination process as was discussed above. The three possi- 
bilities for a point are: i) a point on a face feature; ii) a point 
on an edge feature; and, iii) a point on a vertex feature. A 
point on a face feature is adjacent only the face. A point on 
an edge feature is adjacent the edge and the two faces that 
meet at the edge. A point on a vertex feature is adjacent the 
vertex, the edges that meet at the vertex, and the faces that 
meet at the edges. 

All combinations of features in the two expansion lists 
(again, one list for each object) are potential candidates for 
alignment Each combination is examined in turn, the appro- 
priate alignment is computed, and the best of the alignments 
is determined by the comparison heuristics as explained 65 
above. 

To review and further explain the preferred embodiment 
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of the method and apparatus of the present invention, when 
the user selects an object and drags it within a display scene, 
the apparatus and method of the present invention adapts to 
find the best alignment of the object with any other objects 
in the scene. The cursor specifies a position and orientation 
for the object as it is dragged The method and apparatus of 
the present invention modifies the dragged object's position 
and orientation so that a feature of the manipulated object is 
in better alignment with a feature of an object in the scene. 

At each new position, the features of the dragged object 
are compared to the features of the objects in the scene. The 
present invention determines the closest points on the most 
restrictive features between the manipulated object arid the 
other objects appearing in a scene. An expansion list con- 
taining the features incident to each of the closest points is 
generated. An alignment is generated for each combination 
of features from the two expansion lists. The best alignment 
is utilized to determine and display a new position and 
orientation for the manipulated object 

In general, there may be any number of features in the 
"best" alignment Preferably, it does not matter which one is 
chosen, as long as the choice is repeatable (accomplished in 
the present invention by using the same sort order each time, 
as was explained above). If the choice changed between 
successive iterations, then user feedback could be confusing. 

Note that no state information need be remembered 
between object manipulations. The alignment is completely 
specified by the object position and its associated geom- 
etries. 

OBJECT REPRESENTATION 

In the preferred embodiment, an object is represented as 
a mesh of polygonal faces that completely tile the object's 
surface. For example, a cube is described by its six faces, as 
well as the vertices at the corners and the edges that connect 
the vertices and faces. Holes are permitted, so objects may 
be topological^ manifold. 

In the preferred embodiment of the method and apparatus 
of the present invention, any feature (face, edge or vertex) 
can be accessed from any adjacent feature. This is accom- 
plished by storing objects in a Winged Edge data structure, 
as is well known in the art The Winged Edge data structure 
represents a polygonal mesh surface as a set of vertices, 
edges and polygonal faces. A vertex contains its coordinates 
in space, along with a reference to one of the edges that are 
adjacent to the vertex. A face contains a reference to one of 
the edges that bound the face. An edge contains references 
to the two vertices that are its endpoints, the two polygons 
that meet at the edge, and to four other edges. The four edge 
references indicate the next clockwise edge and counter- 
clockwise edge at each endpoint The Winged Edge data 
structure thus allows fast access from an feature to all of the 
features that are adjacent to it. Note that portions of the 
method and apparatus of the present inversion are simplified 
by requiring all faces to be closed and convex. 

The method and apparatus of the present invention may 
operate on a geometric description that is different from the 
representation used for. displaying the object. For example, 
the "alignment geometry" might be broken down into 
greater or fewer polygons than utilized for the display 
geometry. Alternately, less than all features of the object may 
be represented by the alignment geometry, for example, the 
alignment geometry of a chair might specify just the plane 
of the chair's feet, and the shapes of the seat and back to 
facilitate aligning the chair. 
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Note that the integration of the present invention with a 
direct manipulation graphical user interface yields powerful 
functionality without interface clutter. 

Referring now to FIG. 10, four alternative embodiments 
of the present invention will now be reviewed, 5 

In the magnet and refrigerator door scenario, for example, 
in an alternative embodiment and as indicated by example 
(a) of FIG. 10, the magnet object can be aligned with 
multiple other objects simultaneously. This feature would be 
very useful in a graphic editor. 

Certain positions on an object's alignment geometry may 
be more significant than others. A user may want to position 
a lamp at the center of a table, for example. In another 
alternative embodiment, frequently used special points, like 
face and edge midpoints, as indicated in example (b) of FIG. 
10 can be automatically included in the alignment geometry, 
and others might be added in the modeling process. 

Note that in a still further alternative embodiment, other 
object representations are possible as indicated by example 20 
(c) of FIG. 10. For example, the present invention could be 
extended to utilize spline patches instead of flat polygons, 



22 



thus facilitating more precise representations of curved 
surfaces. Solid or volumetric representations could likewise 
be accommodated. 

In an even further alternative embodiment, once the user 
aligns two objects; the system of the present invention could 
maintain the alignment and moves the two objects as a single 
object or group as indicated by example (d) of FIG. 10. This 
capability would preferably include an interface selection 
such as, for example, keyboard commands or menu selec- 
tions for creating and breaking such multiple object align- 
ments. 

Still further, and referring again to example (d) of FIG. 10, 
the user could also use a "shift-click" operation, as is well 
known in the art, to select more than one object at a time 
without having to align these separate objects, and then treat 
these multiple selected objects as an aggregate or single 
object for purposes of movement and alignment with 
another object or objects in the scene. 

What follows is a pseudocode listing of the alignment 
methodology of the preferred embodiment of the present 
invention: 



PSet <=set of all features that are being aligned 
QSet €=set of all features that are being aligned to 
d* ^h 
P* <=<} 
Q' «={> 

for each feature P in PSet 

for each feature Q in QSet 
if P is a vertex 

p <= world-space coordinates of P 
if P is an edge 

Po ^world-space coordinates of one endpoint of P 

p j <= world-space coordinates of the other endpoint of P 
if P is a face 

p world- space coordinates of some point on P 
n <= world-space vector normal to P 

if Q is a vertex 

q <= world- space coordinates of Q 



if Q is 1 



% world-space coordinates of one endpoint of Q 



Qi $= world-space coordinates of the other endpoint of Q 
if Q is a face 

q world-space coordinates of some point on Q 
n world-space vector normal to Q 

if P is a vertex and Q is a vertex 
a C=p 
b «=q 

go to ACCEPT 

if P is a vertex and Q is an edge 

t ^(p tqi-qoJ-q Cq.-qoJ^Cq^oXqi-qo)) 



1 V— U^VHj- 
if0<t< 1 

a <=p 

go to ACCEPT 



else 



go to REJECT 



if P is a vertex and Q is a face 
a <=p 

b <=p - ((q-p>n)n 
r <=b 

if P is an edge and Q is a vertex 

t (q - (pr-po) - p • (Pi-Po)y((Pi-Po) (p,-Po)) 
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-continued 



go to REJECT 
if P is an edge and Q is an edge 



if 0 < t < 1 



else 



b <=q 

go to ACCEPT 



if v • v = 0 go to REJECT 
ti <=*to-Vo Qr<lo vl/(v • v) 

F 0 < ij < 1 



^^•qo-PoPi-PoVl/(v- V) 
u 0 < ti < 1 and 0 < tj < 1 



else 



a = Po + h (Pi-Po) 
b = q 0 + t» (qi-<In) 
go to ACCEPT . 

go to REJECT 



if P is an edge and Q is a face 

if 0 < t < 1 

a <=Po + t(P]-Po) 
b <=a 
r <=a 
F <=Q 
go to CUP 



else 



go to REJECT 



ifPisafaceandQisa vertex 
a <=q - ((p-q) n)n 



goto 



&JP 



if P is a face and Q is an edge 

t ^(n -CqrrPMn -Cq^) 
if 0<t< 1 

a ^Po + tCpj-po) 
b £=a 
r <=a 
F <=P 
go to CUP 



else 



go to REJECT 



if Pis a face and Q is a face 
go to REJECT 



CLIP 



for each edge, e, of face F 

Co ^world-space coordinates of clockwise endpoint of edge e 

e. world-space coordinates of counter-clockwise endpoint of edge e 

if (r-*o) • ((e,-^ x n) > 0 go to REJECT 

go to ACCEPT 



ACCEPT 



REJECT 



d ^vm-bj* + (jyV + (a.-bj 2 ) 
if d < d 

d' <=d 
a' <=a 
b' <=b 
F ^P 

end of loop - get next pair (P, Q) 
end of loop - get next pair (P, Q) 



for each feature P that is adjacent to F 

for each feature Q that is adjacent to Q* 
if P is a face and Q is a face 
call to PARALLEL 

otherwise if P is an edge and Q is an edge 
call to PARALLEL 
call to POSITION-ONLY 
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otherwise if P is an edge and Q is a face, orPUataceandQisan edge 
can to ORTHOGONAL 

otherwise 

call to POSITION-ONLY 

ifg'>0 

move PSet by composing the transformations: 
translate a' to the origin 
if g' * 1, rotate through w(tT) 8' about v* 
translate the origin to (l-w(d"))a' + w(£)b' 

FINISHED 

procedure PARALLEL 
Odor ' Pdcr ^ 0 

else 

v ^= normalize (B^ x P^) 
6 ^sscos" 1 (B^ P^ 

if 9 > maxAnglc return to caller 

8 <=3 

go to COMPARE 
procedure ORTHOGONAL 

Bdor <= normalize (P^ - (Q^ • P^Q^r) 

v ^normalize (B^ x P^,) 

9 <= cos -1 (B^ • P^) 

if 9 > maxAnglc return to caller 
g <=2 

« ^-(B^- P^) 
go to COMPARE 
procedure POSITION-ONLY 

8 «=0 

go to COMPARE 
COMPARE 

if g > g\ or g = g' and s > s' 

v' £=v - 

8' $=0 

g* <=g 

return to caller 



The description of the invention given above is intended 45 
to be interpreted broadly. Such modifications and variations 
of the embodiments of the present invention described 
above, that may be apparent to a person skilled in the art, are 
intended to be included within the scope of this invention. 
What is claimed is: so 
1. A method for aligning a first object to a second object 
in a computer system comprising a processor, memory, 
display and graphic object controller, the method compris- 
ing: 

a) displaying the first object and the second object on the 55 
computer display; 

b) displaying a cursor on the computer display, said cursor 
coupled to the graphic object controller; 

c) selecting with the cursor coupled to the graphic object ^ 
controller the first object displayed on the computer 
display; 

d) manipulating with the graphic object controller the first 
object displayed on the computer display towards the 
second object displayed on the computer display; 65 

e) providing an alignment field gradient emanating from 
the second object; and 



0 aligning the first object to the second object in accor- 
dance with the alignment field gradient. 

2. The method of claim 1 wherein the step of aligning 
starts when the first object is manipulated with the graphic 
object controller to within a first redetermined distance 
from the second object and finishes when the first object is 
manipulated with the graphic object controller to within a 
second predetermined distance from the second object 
wherein the second predetermined distance is smaller than 
the first predetermined distance. 

3. The method of claim 2 wherein the step of aligning 
further comprises displacing the position of the first object 
from the position of the cursor coupled to the graphic object 
controller according to a strength of the alignment field 
gradient. 

4. The method of claim 3 wherein the step of aligning the 
first object to the second object comprises aligning one 
feature of the first object to one feature of the second object 
wherein a feature can be any element of the set comprised 
of an object's vertices and edges in the case of a two- 
dimensional object and vertices, edges and faces in the case 
of a three-dimensional object 

5. The method of claim 4 wherein vertex features are 
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aligned before edge features and edge features are aligned 
before face features. 

6. The method of claim 5 further comprising displaying 
the cursor inside the first object when the first object is 
selected. 5 

7. Hie method of claim 6 further comprising displaying an 
axis indicator when the cursor is inside of and near the center 
of the first object. 

8. The method of claim 7 further comprising displaying a 
displacement indicator between the axis indicator and the i 0 
cursor inside the first object during the step of aligning. 

9. The method of claim 3 wherein a strength of the 
alignment field gradient is the cubic of the result of dividing 
the difference between the first rredeterrnined distance and 
the current distance between the first object and the second 15 
object and the difference between the first predetermined 
distance and the second predetermined distance. 

10. The method of claim 3 further comprising the step of 
generating a sound effect corresponding to a strength of the 
alignment field gradient exerted on the first object. 2 0 

11. The method of claim 3 wherein the first object is 
comprised of one or more objects and the second object is 
comprised more than one object. 

12. The method of claim 4 wherein the step of manipu- 
lating the first object causes translation and rotation of the 2 5 
first object when the cursor is near a boundary of the first 
object 

13. The method of claim 4 further comprising displaying 
a visual indicator of the alignment field gradient between the 
first object and the second object during the step of aligning. 30 

14. The method of claim 6 wherein the step of manipu- 
lating the first object causes translation of the first object 
when the cursor is inside of and near the center of the first 
object. 

15. The method of claim 6 further comprising displaying 35 
the first object as translucent 

16. An apparatus for aligning a first object to a second 
object in a computer system comprising a processor, 
memory, display and graphic object controller, the apparatus 
comprising: 40 

a) means for displaying the first object and the second 
object on the computer display; 

b) means for displaying a cursor on the computer display, 
said cursor coupled to the graphic object controller, 

c) means for selecting with the cursor coupled to the 45 
graphic object controller the first object displayed on 
the computer display; 

d) means for manipulating with the graphic object con- 
troller the first object displayed on the computer display 5Q 
towards the second object displayed on the computer 
display; 

e) means for providing an alignment field gradient ema- 
nating from the second object; and 

f) means for aligning the first object to the second object 55 
in accordance with the alignment field gradient. 

17. The apparatus of claim 16 wherein the means for 
aligning starts aligning the first object to the second object 
when the first object is manipulated with the graphic object 
controller to within a first predetermined distance from the 60 
second object and finishes aligning the first object to the 
second object when the first object is manipulated with the 
graphic object controller to within a second predetermined 
distance from the second object wherein the second prede- 
termined distance is smaller than the first predetermined 65 
distance. 

18. The apparatus of claim 17 wherein the means for 
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aligning further comprises means for displacing the position 
of the first object from the position of the cursor coupled to 
the graphic object controller according to a strength of the 
alignment field gradient 

19. The apparatus of claim 18 wherein the means for 
aligning the first object to the second object comprises 
means for aligning one feature of the first object to one 
feature of the second object wherein a feature can be any 
element of the set comprised of an object's vertices and 
edges in the case of a two-dimensional object and vertices, 
edges and faces in the case of a three-dimensional object 

20. The apparatus of claim 19 wherein the means for 
aligning one feature of the first object to one feature of the 
second object aligns vertex features before edge features and 
aligns edge features before face features. 

21. The apparatus of claim 20 further comprising means 
for displaying the cursor inside the first object when the first 
object is selected. 

22. The method of claim 21 further comprising means for 
displaying an axis indicator when the cursor is inside of and 
near the center of the first object. 

23. The method of claim 22 further comprising means for 
displaying a displacement indicator between the axis indi- 
cator and the cursor inside the first object when the first 
object is being aligned to the second object. 

24. The apparatus of claim 18 wherein a strength of the 
alignment field gradient is the cubic of the result of dividing 
the difference between the first predetermined distance and 
the current distance between the first object and the second 
object and the difference between the first predetermined 
distance and the second predetermined distance. 

25. The apparatus of claim 18 further comprising means 
for generating a sound effect corresponding to a strength of 
the alignment field gradient exerted on the first object. 

26. The apparatus of claim 18 wherein the first object is 
comprised of one or more objects and the second object is 
comprised of more than one object 

27. The apparatus of claim 19 wherein the means for 
manipulating the first object causes translation and rotation 
of the first object when the cursor is near a boundary of the 
first object. 

28. The apparatus of claim 19 further comprising means 
for displaying a visual indicator of the alignment field 
gradient between the first object and the second object when 
the first object is being aligned to the second object 

29. The apparatus of claim 21 wherein the means for 
manipulating the first object causes translation of the first 
object when the cursor is inside of and near the center of the 
first object 

30. The apparatus of claim 21 further comprising means 
for displaying the first object as translucent 

31. A method for aligning a displayed representation of an 
object comprising the steps of: 

(a) displaying a representation of a first object in an initial 
position on a display screen, the display screen under 
the control of a processor; 

(b) displaying a representation of a second object on the 
display screen; 

(c) moving the representation of the first object toward the 
second object in a visually continuous manner using a 
cursor whose position is controlled by a cursor move- 
ment mechanism; 

(d) calculating a current position for the first object which 
is displaced from a cursor dictated position by an 
amount which is determined as if the first object was 
under the gradual influence of an alignment field ema- 
nating from the second object; and 
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(e) displaying a representation of the first object on the 
display screen in the current position. 

32. An apparatus for aligning a displayed representation 
of an object comprising: 

(a) means for displaying a representation of a first object 5 
in an initial position on a display screen, the display 
screen under the control of a processor, 

(b) means for displaying a representation of a second 
object on the display screen; 

(c) means for moving the representation of the first object 
toward the second object in a visually continuous 
manner using a cursor whose position is controlled by 
a cursor movement mechanism; 

(d) means for calculating a current position for the first l5 
object which is displaced form a cursor dictated posi- 
tion by an amount which is determined as if the first 
object was under the gradual influence of an alignment 
field emanating from the second object; and 

(e) means for displaying a representation of the first object 20 
on the display screen in the current position. 

33. A method for aligning a first object to a second object 
in a computer system comprising a processor, memory, 
display and graphic object controller, the method compris- 
ing: 25 

a) displaying the first object and the second object on the 
display of the computer system; 

b) displaying a cursor on the display of the computer 
system wherein the cursor defines a cursor position on 
the display of the computer system, said cursor coupled 30 
to the graphic object controller; 

c) selecting with the cursor coupled to the graphic object 
controller the first object displayed on the display of the 
computer system; ^ 

d) manipulating with the graphic object controller the 
selected first object displayed on the display of the 
computer system; 

e) providing an alignment field gradient emanating from 
die second object displayed on the display of the 40 
computer system; and, 

f) aligning the manipulated first object displayed on the 
display of the computer system with the second object 
displayed on the display of the computer system 
wherein when the manipulated first object is manipu- 45 
lated with the graphic object controller to within a first 
predetermined distance from the second object the 
displayed location of the manipulated first object on the 
display of the computer system is gradually shifted 
away from the cursor position and towards the dis- 



played location of the second object on the display of 
the computer system and when the manipulated first 
object is manipulated with the graphic object controller 
to within a second predetermined distance from the 
second object the displayed location of the manipulated 
first object on the display of the computer system is 
gradually shifted away from the cursor position and 
into alignment with the displayed location of the sec- 
ond object on the display of the computer system. 
34. An apparatus for aligning a first object to a second 
object in a computer system comprising a processor, 
memory, display and graphic object controller, the apparatus 
comprising: 

a) means for displaying the first object and the second 
object on the display of the computer system; 

b) means for displaying a cursor on the display of the 
computer system wherein the cursor defines a cursor 
position on the display of the computer system, said 
cursor coupled to the graphic object controller; 

c) means for selecting with the cursor coupled to the 
graphic object controller the first object displayed on 
the display of the computer system; 

d) means for manipulating with the graphic object con- 
troller the selected first object displayed on the display 
of the computer system; 

e) means for providing an alignment field gradient ema- 
nating from the second object displayed on the display 
of the computer system; and, 

f) means for aligning the manipulated first object dis- 
played on the display of the computer system with the 
second object displayed on the display of the computer 
system wherein when the manipulated first object is 
manipulated with the graphic object controller to within 
a first predetermined distance from the second object 
the displayed location of the manipulated first object on 
the display of the computer system is gradually shifted 
away from the cursor position and towards the dis- 
played location of the second object on the display of 
the computer system and when the manipulated first 
object is manipulated with the graphic object controller 
to within a second predetermined distance from the 
second object the displayed location of the manipulated 
first object on the display of the computer system is 
gradually shifted away from the cursor position and 
into alignment with the displayed location of the sec- 
ond object on the display of the computer system. 
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